SRI's Experience with the ATIS Evaluation
نویسندگان
چکیده
SRI International participated in the June 1990 Air Travel Information System (ATIS) natural-language evaluation. This report briefly describes the system that SRI used in the evaluation, analyzes SRI's results, and makes some recommendations for changes in the database structure and data collection system to be used for future ATIS evaluations.
منابع مشابه
Annotation of ATIS Data
The performance of spoken language systems on utterances from the ATI$ domain is evaluated by comparing systemproduced responses with hand-crafted (and -verified) standard responses to the same utterances. The objective of SRI's annotation project is to provide SLS system developers with the range of correct responses to human utterances produced during experimental sessions with ATIS domain in...
متن کاملSpeech Recognition in SRI's Resource Management and ATIS Systems
This paper describes improvements to DECIPHER, the speech recognition component in SKI's Air Travel Information Systems (ATIS) and Resource Management systems. DECIPHER is a speaker-independent continuous speech recognition system based on hidden Markov model (HMM) technology. We show significant performance improvements in DECIPHER due to (I) the addition of tied-mixture I-IMM modeling (2) rej...
متن کاملSRI's Real-Time Spoken Language System
PROJECT GOALS This project involves the integration of speech and natural-language processing for spoken language systems (SLS). The goal of this project, to develop a multi-modal interface to the Official Airline Guide database, is being developed along two overlapping research and development lines: one focussed on an SLS kernel for database query, and the other on the full interactive system...
متن کاملExpanding the Scope of the ATIS Task: The ATIS-3 Corpus
The Air Travel Information System (ATIS) domain serves as the common evaluation task for ARPA"spoken language system developers. 1 To support this task, the Multi-Site ATIS Data COllection Working group (MADCOW) coordinates data collection activities. This paper describes recent MADCOW activities. In particular, this paper describes the migration of the ATIS task to a richer relational database...
متن کاملOn-Time Reliability Impacts of Advanced Traveler Information Services (ATIS): Washington, DC Case Study
Internet-based Advanced Traveler Information Services (ATIS) provide the urban traveler with estimated travel times based on current roadway congestion. Survey research indicates that the vast majority of current ATIS users are satisfied consumers who feel they save time by utilizing these services on a regular basis. However, in numerous field experiments and simulation studies, ATIS users exp...
متن کامل